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A Port-Hamiltonian Approach to Optimal Frequency Regulation in 

Power Grids 
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Abstract —This paper studies the prohlem of frequency 
regulation in power grids, while maximizing the social welfare. 
Two price-hased controllers are proposed; the first one an 
internal-model-hased controller and the second one based on a 
continuons gradient method for optimization. Both controllers 
can he implemented in a fully distrihuted fashion, with freedom 
in choosing a controller commnnication network. As a resnit, 
two real-time dynamic pricing models described by port- 
Hamiltonian systems are obtained. By coupling with the port- 
Hamiltonian description of the physical network we obtain a 
closed-loop port-Hamiltonian system, whose properties are ex¬ 
ploited to prove asymptotic stability of the set of optimal points. 
Numerical results show the performance of both controllers in 
a simple case study. 

I. Introduction 

Stability of power networks is becoming an increasingly 
important topic in recent years. Especially with the growth of 
renewable energy sources there is an increasing fluctuation 
in the supply of power. As a result, it is more difficult for 
traditional energy sources to match the supply with the de¬ 
mand. To alleviate some of these problems, we may introduce 
a feedback mechanism that encourages the consumers to 
change their usage when it is difficult for the generators and 
the network to match demand. One approach is by using 
real-time dynamic pricing as a control method. 

The idea of using dynamic pricing to achieve optimal 
supply-demand matching is not new in the literature on 
power networks. For a historical paper on dynamic pricing 
and market stability we refer to [1]. See e.g. also [2] and [3] 
for more recent papers on real-time dynamic pricing, which 
mainly focus on the economic part of optimal supply-demand 
matching. However, the coupling between the solution of 
the optimization problem and the physical dynamics of the 
network should not be ignored as this could result in insta¬ 
bility of the grid [4]. The coupling between the physics of 
the power network with the market dynamics has previously 
been studied in for example [4], [5], and [6]. 

In this paper, we propose a new approach for the modeling, 
analysis and control of smart grids based on using energy 
functions, both for the physical network as well as for the 
dynamic pricing algorithm. The underlying framework is 
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based on the theory of port-Hamiltonian systems, which 
lends itself to the integration of dynamic pricing algorithms 
that allow to consider economical factors in the control 
of smart grids. The objective is to have producers and 
consumers to fairly share utilities and costs associated with 
the generation and consumption of power. The challenge 
of achieving this in an optimal manner is called the social 
welfare problem. Simultaneously, the goal is to achieve zero 
frequency deviation w.r.t. to the nominal value (e.g. 50 Hz) 
in the power network. 

One of the approaches to solve an optimal frequency 
regulation problem is by using an internal-model-based 
controller as in [7], [8]. We will continue along the same 
lines as in [7] which, among other things, treated optimal 
frequency regulation in case of quadratic power production 
cost functions and constant unknown demand. The first main 
contribution of this paper is that we extend the results 
of [7] where we will include a quadratic consumer utility 
function. The internal-model-based controller proposed in [7] 
is modified accordingly so that it steers the trajectories to 
the points of maximal social welfare while regulating the 
frequency. Moreover, this is all achieved within the port- 
Hamiltonian framework. In particular, we will show that the 
dynamics of the physical model of the power network as well 
as the real-time dynamic pricing model can be represented 
as port-Hamiltonian systems. 

Another well-known controller design method for solving 
a(n) (social welfare) optimization problem is primal-dual 
gradient method based control. The literature on the gradient 
method has become quite extensive over the last decades, 
starting with the monograph [9]. Also in power grids this 
method is often applied to design distributed controllers, 
see for example [4], [6] and [10]. Our contribution to the 
existing literature consists in showing that the real-time 
dynamic pricing model obtained when applying the gradient 
method can be represented as a port-Hamiltonian system, 
which demonstrates that the port-Hamiltonian framework 
can be extended from physical system modeling to markets 
dynamics as well. 

The outline of this paper is as follows. In Section |I^ we 
first state the preliminaries on the power network model 
and the social welfare problem. Next, we introduce an 
internal-model-based controller in Section]^ and discuss its 
asymptotic stability. Thereafter in Section we propose a 
gradient method based controller in port-Hamiltonian form 
and we perform a similar stability analysis. Numerical results 
on both controllers will be discussed subsequently in Section 
[V] Finally, we state suggestions for future research. 


II. Preliminaries 
A. Power network model 

Consider a power grid consisting of n buses. The network 
is represented by a connected and undirected graph Q — 
(V,£), where the nodes, V = {1, ...,n}, is the set of buses 
and the edges, £ C V x V = m}, is the set of 

transmission lines connecting the buses. The ends of edge k 
are arbitrary labeled with a ‘+’ and a so that the incidence 
matrix D of the network is given by 

{ +1 if i is the postive end of k 
— 1 if i is the negative end of k 
0 otherwise. 

Each bus represents a control area and is assumed to have 
controllable power generation and a price-controllable load. 
The dynamics at each bus are assumed to be given by [7], 
[ 11 ] 

— ^ig ^id ^ ^ 

3<^Mi 

which are commonly known as the swing equations. We use 
here the following notations. 

5i Voltage angle at bus i 

uJl Frequency at bus i 

Nominal frequency 

uji Frequency deviation at bus i, i.e. wf — w" 

Vi Voltage at bus i 

Mi Moment of inertia at bus i 

Ai Damping constant at bus i 

Mi Set of buses connected to bus i 

Bij Susceptance of the line between buses i and j 

Udi Power demand at bus i 

Ugi Power generation at bus i 

Assumption 1: By using the power network model Q the 
following assumptions are made, which are standard in a 
broad range of literature on power network dynamics. 

• Lines are lossless, i.e., the conductance is zero. This 
assumption is generally valid for the case of high 
voltage lines connecting different control areas. 

• Nodal voltages Vi are constant. 

• Reactive power flows are ignored. 

• A balanced load condition is assumed, such that the 
three phase network can be analyzed by a single phase. 
Define the voltage angle differences between the buses by 
Tj = £>^(5. Further define the angular momenta by p := Muj 
where w = w*’ — w" the (aggregated) frequency deviations 
and M = diag(Mi,..., M„) are the moments of inertia. 
Let r = diag(7 i,... ,7^) and 7^ = ViVjBij where k cor¬ 
responds to edge {i,j) G S. Finally, define the Hamiltonian 
Hpiv,p) by 

Hpir],p) = t'^Tcosq, (2) 


which consists of kinetic energy and a pendulum like poten¬ 
tial energy. The swing equations 0 are then represented by 
the port-Hamiltonian system 

£>'^1 

V£fp(77,p) 


y = 


0 

-D -A 

0 / ■ 

0 -I 


0 0 
/ -I 


VHp{r],p) = 


M ^p 


UJ 

—M~^p 


—UJ 


(3) 


where u = {ug,Ud). Note that the system 0 satisfies the 
passivity property 

Hp = p^M~^p + (r sin 77)^?) = p^M~^ {—DT sin 7 
— AM~^p + Ug — Ud) + (r sinp)^£)^M“^p 
= —uFAijj + uM{ug — Ud) < u^y- 

For an extensive study on the stability and equilibria of the 
swing equations based on the Hamiltonian function Q, we 
refer to [7]. 

B. Social welfare problem 

We define the social welfare by U{ud) — C{ug), which 
consists of a utility function U{ud) of the consumers Ud 
and the total power generation cost C{ug) associated to 
the producers Ug. The objective is to maximize the social 
welfare under the constraint of zero frequency deviation. 
We assume that C{ug) is a strictly convex function and 
U{ud) is a strictly concave function so that we will obtain 
an optimization problem which is convex. 

By analyzing the equilibria of 0. it follows that a neces¬ 
sary condition for zero frequency deviation is Ud = 

[7], i.e., the total supply must match the total demand. 
It can be noted that {ug,Ud) is a solution to the latter 
equation if and only if there exists a v G such that 

D^v — Ug + Ug = 0 where G is the incidence 

matrix of some connected communication graph with rric 
edges and n nodes. This communication graph may be 
different from the physical network topology and will play a 


central role in the controllers proposed in Sections III and IV 


Because of the latter equivalence, we consider the following 
convex minimization problem: 


mm 

Ug,Ua,V 


R{Ug.,Ud) ■ ^i^g) U{uf) 


(4) 


S.t. DcV — Ug -\- Ud = Q. 

The corresponding Lagrangian is given by 

£ = C{ug) - U{ud) + \^{DcV -Ug-G Ud) 

with Lagrange multipliers A G K". The resulting first-order 
optimality conditions (V£ = 0) are given by 

VC(ug) - A = 0 
-VU(ud) + A = 0 


Di\ = Q 


(5) 


DcV-Ug+Ud = Q. 

Since the minimization problem is convex it follows that 
{ug,Ud, V, A) is an optimal solution to Q if and only if it is 
a solution to which is a standard result in the literature 
on convex optimization [12]. 















(6) 


III. Internal-model-based controller 

In this section we extend the results of [7] in which we 
include a utility function for the demand. We assume that 
the utility functions are quadratic and given by C(ug) = 
^UgQgUg + c^Ug,U{ud) = -\u^QdUd + whete 

QdiQg G are symmetric positive dehnite matrices 

and c,b G K". Consider the minimization problem Q. The 
hrst-order optimality conditions in this case amount to 

QgUg c — A = 0 
Qd^d b A — 0 
Z7fA = 0 

DcV - Ug + Ud = 0. 

Note that QgUg + c are the (aggregated) marginal costs of the 
producers and likewise —QdUd + b are the marginal utilities 
of the consumers. Observe from that the prosumers 
(combination of producers and consumers) achieve maximal 
welfare if and only if their marginal costs and utilities 
respectively are equal to the price A, which is a standard 
result in economics. The optimal production and demand are 
therefore given by 

ig = Qg (A — c) 


u, 


- 1 / 
g 

Ud = Qd^{b - A). 


Ug = Q-\tX* -c) = l^ Q^\b - lA*) = Ud 


X = tX* 


X* = 


t^{Qg^C + Q^^b) 


+Qd )1 

Based on the controller design proposed in [7], we con 
sider the following price-based controller dynamics in port 
Hamiltonian form with inputs ux and outputs yx: 


X = -L,VH,{X) + [Q-^ -Q2^] ux 


y\ = 


Q-g 


-Qd\ 


Vi7e(A) 


-Qg 

. QJ'i’ . 


'y 


■ 0 

0 

P 

= 

-D 

-A Q-g^+Q-d^ 

A 


0 

-Qg ^ -Qc^ -Lc 


0 

Qg^(^ + Qd^^ 

0 

where x = {r],p, A) and the Hamiltonian is given by 
H{x) = Hp{r],p) + Hc{X) 

= ^p^M-^p - l^r cos p -f i A^A. 


The equilibria of ( [T0| ) are all {fj,p,X) satisfying 

p = 0 

0 = -DT sinp -I- {Q~^ + Qd^)X - Qg^c - Qd^b 
l^{Qg^c + Q-^b) 


A = 1A* 


A* = 


( 11 ) 


(7) 


From the third equation of (|^ it follows that the prices must 
be identical in each control area, i.e., A = lA*, where the 
common price A* is computed as 


( 8 ) 


(9) 


The controller Hamiltonian is given by Hc{X) = |A^A and 
Lc = DcD^ is the Laplacian matrix of the communication 
graph. We interconnect systems and in a power¬ 
preserving way by ux = —y,u = yx- Then we obtain the 
closed-loop port-Hamiltonian system 


Vi7(x) 


( 10 ) 


t^iQg^+QdQT^ 

We dehne Hi as the solution set of ( [TT| l, i.e. 

Hi = {{fj,p,X) I {fj,p,X) is a solution to ([TT])}. 

For proving local asymptotic stability of the closed-loop 
system ( [T0| ) an additional assumption is required. 

Assumption 2: There exists a {fj,p,X) G Hi such that 
fjk G {—TT 12,7^ 12) for all k G S. 

This assumption is standard in studies on power grid 
stability and is also referred to as a security constraint [13]. 

A. Stability 

We will show that trajectories {ri,p,X) satisfying 
and initialized sufficiently close to an equilibrium point of 
( [T0| l converge to the set Hi. Moreover, we show that this 
set corresponds to the optimal points of the social welfare 
problem. 

Theorem 1: For every x G fti satisfying Assumption 
there exists an open neighborhood O around x such that 
all trajectories x satisfying ( [T0| with initial conditions in O 
converge to the set Hi. Moreover, the power generations and 
demands converge to the optimal value given by 0 and ([^. 

Proof: Since the system ( [TOl i is not centered around the 
origin we introduce a shifted Hamiltonian H w.r.t. a; G Hi 
[7],[14], which will act as a Lyapunov function: 

H{x) := H{x) — (x — x)^X/H{x) — H{x) 

= ^p'^M-^p - l^F cos r? + ^ A^A 


— [t]'^ — t]'^ 0 A^ — A^] 


2 

F sin fj 
0 
A 


( 12 ) 


— l”r cos rj + 2^X 

= + ^(A - A)'^(A - A) 

— l^F cos y — {rj — sin y + l^F cos y. 

Bearing in mind Assumption and [15], the shifted Hamil¬ 
tonian satishes H{x) = 0 and H{x) > 0 for all x in an 
sufficiently small open neighborhood around x. Moreover, 
the shifted Hamiltonian satishes S7H{x) = VH{x) — VH{x) 
so that can be rewritten as 

0 0 

-D -A 


t-i 


-f 


. 0 -Qg^ - Q, 

0 

-DT siny + {Q-^ + 


:g + Q 
-Lr 


X/H{x) 


)X-Qf^c-Qf^b 


— LnX 


0 

-D -A 

0 -Qt' - 


Qg + Qd 
-Lr 


-1 


VH{x). 






















Because of the port-Hamiltonian structure of the system it 
easily follows that the shifted Hamiltonian satisfies 

i? =(A-A)^Lc(A-A) < 0, (13) 

where equality holds if and only if w = 0 and A = A + la 
for some scalar function a. On the set H — 0 we have 

?) = 0 

p = —DT sinry + DT sin?) + {Qg^ + = 0 

A = 0 


a port-Hamiltonian representation which is given by 


xe = 


-f 


VE = 


0 0 0 

0 0 0 

0 0 0 

-I I D, 

7 0 ‘ 

0 / 

0 0 
0 0 

7 0 0 o' 
0/00 



VH^{xe) - ^R{ze) 


VH,{xe)= ® 


( 15 ) 


On the largest invariant set where // = 0 we must have that 
a = 0 , which follows from premultiplication of the second 
equation by 1^. Hence, by LaSalle’s invariance principle 
p —>■ 0, A —)■ A ,?7 —)■ fi as t —>■ oo, for some constant t) 
satisfying 


DT sin fj = DT sin 77 = (Qg ^ ^)A - Qg^c- ^b. 

Hence x ^ Tli as t ^ 00 . Moreover, since the interconnec¬ 
tion between the controller and the swing equations Q is 
given by 



= u = yx = 


■Qg-'(A-cy 

Q-a\b-\)^ 


it follows that the power generations and demands converge 
to the optimal value given by 0 and 0 as f — 00 . ■ 


IV. Primal-dual gradient controller 


By applying the primal-dual gradient method [4], [ 6 ], [9] 
to the minimization problem 0 , we obtain the real-time 
dynamic pricing model 


Tgilg = —VC{Ug) + X + Wg 

TdUd = VU{ud) -\ + Wd 

TyV = -DJX 

TxX = DcV - Ug + Ud 


(14) 


where we introduce additional inputs w = {wg,Wd) 
which are to be specified later on. Here te = 
blockdiag(Tg, ta) > 0 correspond to the timescales 
of the controller. Note that we have constructed a distributed 
controller where Xi acts as a price in control area i gV and 
V represents the information exchange of the differences of 
the prices A along the edges the communication graph. 

Let us define the energy variables Xe = {Xg, Xd, Xy,Xx) = 
(TgUg, TdUd, TyV, taA) = and notice that in the sequel, 
we interchangeably write the system dynamics in terms of 
energy variables (denoted by x) and co-energy variables 
(denoted by z) for ease of notation. 

An interesting fact is that the market dynamics ([T^ admits 


with the quadratic controller Hamiltonian 

Hc{xe) = (16) 

Note that the latter system is indeed a port-Hamiltonian sys¬ 
tem since R is convex and therefore satisfies the dissipativity 
property 

(21 - Z2)^(V/?(zi) - VR{z2)) > 0, Vzi, Z2 G 

We obtain a power-preserving interconnection between 0 
and ( fTSj l by choosing w = —?/,m = tje- Define the extended 
vectors of(co-)energy variables by a? = {ri,p,XE), z = 



Ze) 

then 

the 

closed- 

loop 

port-Hamiltonian 

system 

takes 

the form 








■ 0 

D'^ 

0 

0 

0 

0 




-D 

-A 

I 

-I 

0 

0 



X = 

0 

0 

-I 

I 

0 

0 

0 

0 

0 

0 

I 

-I 

VH{x) - 

V/?(z) 


0 

0 

0 

0 

0 

-D^ 




0 

0 

-1 

I 

Dc 

0 




(17) 


with H the sum of the energy function 0 corresponding to 
the physical model, and the controller Hamiltonian ( |T6] l. We 
define the equilibrium set of ([T^, expressed in the co-energy 
variables, by 

TI 2 = {z \ z is an equilibrium of ([TtIi}. (18) 

It is noted that H 2 is equal to the set of all z that satisfy the 
KKT optimality conditions 0 and simultaneously satisfy the 
zero frequency constraints 


—DT sin rj + Ug — Ud = 0, w = 0 

of the physical network 0. Hence, TI 2 corresponds to the 
desired equilibria. 

A. Stability 

Theorem 2: For every z GTI 2 there exists an open neigh¬ 
borhood O around z such that all trajectories z satisfying 
0 with initial conditions in O converge to the set 0 , 2 - 
Proof: Let z G H 2 and let this equilibrium be 

expressed in the energy variables by defining the vector 
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Fig. 1. A power grid consisting of 4 control areas [7]. 


X = (77, 0 , TgUg, TdUd, TyV, T\X). Lct the shifted Hamiltonian 
H around x be given by 

H{x) = H{x) — {x — x)^VH{x) — H{x) 

= +]^{xe- XE^^T^^iXE - Xe) 

— l^r cos r] — {t] — fj)^T sin fj + cos fj. 


As mentioned in the proof of Theorem [T] it can be shown 
that H{x) = 0 and H{x) > 0 for all a; in a sufficiently small 
open neighborhood around x. After rewriting, the closed loop 
port-Hamiltonian system ([T 7 | is equivalently described by 


0 

-D 

0 

0 

0 

0 


-A 

-I 

I 

0 

0 


0 

I 

0 

0 

0 

-/ 


0 

-/ 

0 

0 

0 

I 


0 

0 

0 

0 

0 

Dr 
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0 

I 

-I 

-D^ 

0 


WH{x) 


-VR{z) +VR{z). 


The shifted Hamiltonian H satisfies 

H = -uFAuj -(z- zf(VR(z) - VR(z)) < 0 


where equality holds if and only \f oj = Q,Ug = Ug,Ud = Ud 
since R{z) is strictly convex in Ug and Ud- On the largest 
invariant set S where H = 0 we have A = A and therefore 
V is constant. We conclude that S' C H2 and by LaSalle’s 
invariance principle it follows that z —> S C H2 as f > 00. 


Comparison of both controllers 

When comparing both controllers it is noticed that the 
internal-model-based controller requires that the utility and 
cost functions are quadratic. Since the matrices Qg,Qd 
appear in the closed-loop interconnection structure ( fTO) !, it 
would be challenging to generalize the internal-model-based 
controller to the case where general strictly convex utility 
functions are considered. On the other hand, by applying the 
primal-dual gradient method to the optimization problem (j^ 
it is possible to construct a distributed controller that can 
deal with general convex utility functions. 

Remark 1 : The controller variables A of both controllers 
are interpreted as the electricity prices, where we may have 
different prices in each of the control areas initially. Note that 


the controllers differ in the way they compensate for the price 
differences. On the one hand, the v dynamics of the gradient 
method based controller integrates the differences between 
the prices A. On the other hand, in the intemal-model- 
based controller these differences are dissipated through the 
Laplacian matrix Lc, by inferring from ( [T3] l that as long as 
A is not in the range of 1, energy will be dissipated from the 
system. This has a stabilizing effect on the overall dynamics 
of the closed-loop system in case the internal-model-based 
controller is applied, see also Section |V] 

What both controllers have in common is that in the design 
of the distributed controllers there is freedom in choosing 
any communication graph, as long as the graph is connected. 
Another remark is that, if we would assume that 

n n 

C'(Wff) = U{Ud) ='^Ui{Udi), 

i=l i=l 

both distributed controllers in each control area require only 
information about their individual utility and cost functions, 
which is beneficial for privacy reasons. 

V. Numerical results 

We illustrate the performance of both proposed controllers, 
when applied to an academic test case, where we consider 
4 control area^ see Figure To compare both controllers 
we use identical quadratic utility and cost functions in the 
social welfare problem. The parameters used for both cases 
are given by Qg = diag(l, 2,3,4), M = T = Qd = ^A = 
/, c = 0,6 = col(l, 1.25,1.5,1.75), He = D,te = I. 

We initialize at (optimal) steady operation, while at time 
f = 1 we introduce a change in the utility function of 
the demand corresponding to area 4 by changing b into 
b — col(l, 1.25,1.5, 2), i.e., the consumption of electricity 
becomes more attractive in this area. The simulations of 
the closed-loop systems are plotted in Figure and At 
steady state we observe that the power production is higher 
in the control areas with lower costs functions and similar 
conclusions can be drawn for the power consumption. Hence 
at steady state, the social welfare is maximized. 

When the consumers utility function is changed, we ob¬ 
serve that the consumption increases in control area 4, as 
we would expect. As a consequence, the common electricity 
price rises so that the power demands in the other control 
areas decrease. Simultaneously, the power production is 
increased to match the total supply and demand. It follows 
that the closed-loop dynamics converges again to the point 
where the social welfare is maximized. It is noted that both 
controllers show comparable performance with the gradient 
method based controller showing a slightly more oscillatory 
behavior, which can be explained by Remark 

VI. Conclusions and future research 

In this paper we proposed a novel way of modeling, 
analysis and control of smart grids based on the port- 
Hamiltonian framework. We have proposed two different 

'This example is based on the 4 control area case study discussed in [7]. 
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Fig. 2. Performance of the intemal-model-based controller. At time t = 1 
the consumers utility function con'esponding to control area 4 is changed, 
so that consumption of electricity becomes more attractive in this area. 
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Fig. 3. Performance of the gradient method based controller. The same 
parameters and change in the utility function are considered as in the results 
shown in Figure]^ Note that the gradient method based controller shows 
a slightly more oscillatory behavior, since it contains additional layers of 
integrators compared to the internal-model-based controller. 


types of distributed real-time price-based controllers that 
achieve frequency regulation, while maximizing the social 
welfare. One controller is internal-model-based and the other 
is gradient method based. In the controller design there is 
freedom in choosing any connected communication graph. 
An important result is that the market dynamics, obtained 
from applying the two proposed price-based controllers, can 
be represented in a port-Hamiltonian form. By coupling 
this with the port-Hamiltonian representation of the physical 
power network, a closed-loop port-Hamiltonian system is 
obtained whose properties are exploited to prove asymptotic 
stability to the set of optimal points. By applying the real¬ 
time dynamic pricing models to the same (academic) test 
case, numerical results have shown the performance of 
both controllers in case of quadratic utility functions, and 


show convergence to the point where the social welfare is 
maximized, even after a change in the consumers utility 
function. 

Future research 

In this paper we only considered the total supply-demand 
matching constraints in the social welfare problem. A nat¬ 
ural extension for future research is to include additional 
inequality constraints, which for example correspond to 
congestion. Although the model for the power network used 
here is relatively simple, it provides a good starting point 
for considering more complex physical models of the power 
grid in the port-Hamiltonian framework. In these models one 
may for example include reactive power and voltage control. 
In addition to the proposed controller design methods, one 
would also like to develop controllers that can deal with 
uncertainties in the (demand) utility functions. 
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